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1 LOCATION-REFERENCED 

2 PHOTOGRAPH REPOSITORY 

3 BACKGROUND OF THE INVENTION 

4 The present invention relates to a system that enables persons to store and retrieve 

5 photographs and other images. 

6 Digital photography has affected the ways that people take and use photographs. 

7 For example, because digital photographs exist as data files on computer-readable media, 

8 persons can easily exchange copies of digital photographs with friends and family 

9 members. 

10 Digital cameras are expected to become more common as they become smaller 

1 1 and less expensive. As digital cameras become smaller and less expensive, they are 

12 being incorporated into other devices, such as PDAs ("personal digital assistants") and 

13 portable phones. As digital cameras become more available, people are expected to take 

14 more and more digital photographs. 

15 Although digital photography has resulted in significant changes in the ways that 

16 people take and use photographs, there continues to be room for further improvements. 

17 One consideration associated with the large number of digital photographs being taken is 

18 how to organize them. Although taking photographs is easier and less expensive, it can 

19 be difficult to find a particular photograph because there are so many. 

20 Accordingly, it is an objective to provide ways to organize photographs. 

21 It is another objective to provide a way for users to exchange photographs. 
22 

23 SUMMARY OF THE INVENTION 

24 To address these and other objectives, the present invention includes a photograph 

25 repository system. The photograph repository system includes data storage for storing 

26 photographs in the form of digital data files and a search feature that provides for 
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1 searching for photographs by location and optionally by other search criteria. In one 

2 embodiment, the photograph repository system is a service accessible to users over a 

3 common data network, such as the Internet. In the photograph repository service, each 

4 stored photograph is associated with a location, i.e., where the photograph was taken 

5 and/or the location of an object in the photograph. Users can search for and obtain copies 

6 of their own photographs, i.e., that they had stored previously with the photograph 

7 repository service. In addition, users can search for and obtain copies of photographs that 

8 had been taken by other users and stored with the photograph repository service. 



9 In alternative embodiments, the photograph repository system is implemented as a 

10 standalone system, a hybrid system, or a peer-to-peer system. 
11 

12 BRIEF DESCRIPTION OF THE DRAWINGS 

13 Figure 1 is a diagram showing a first embodiment of a photograph repository 

14 system. 

15 Figure 2 is a flowchart showing a process performed by the photo acceptance 

16 application of Figure 1 . 

17 Figure 3 is a block diagram showing components of the photo database of 

18 Figure 1. 

19 Figure 4 is a flowchart showing a process performed by the photo retrieval 

20 application of Figure 1 . 

21 Figure 5 is a diagram showing a peer-to-peer embodiment of a photograph 

22 repository system. 

23 Figure 6 is a diagram showing a standalone embodiment of a photograph 

24 repository system. 

25 Figure 7 is a diagram showing a hybrid embodiment of a photograph repository 

26 system. 

27 
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1 DETAILED DESCRIPTION OF THE 

2 PRESENTLY PREFERRED EMBODIMENTS 

3 I. FIRST EMBODIMENT 

4 A. Overview of system 

5 Figure 1 shows a first embodiment of a photograph repository (or archive) system 

6 100. In Figure 1, users 1 10 have digital photographs. The digital photographs are in the 

7 form of data files 114 stored in suitable image formats, such as * jpg, *.bmp, or *.png. 

8 Other suitable file formats may be used. The data files 1 14 that comprise the digital 

9 photographs are stored on suitable data storage media 116, such as flash memory cards, 

10 computer hard drives, CD-ROMs, DVDs, and so on. Any suitable data storage media 

11 may be used. 

12 The digital photographs may be obtained from digital cameras 120 that are 

13 operated by the users 1 10. The digital cameras 120 may be standalone units or may be 

14 incorporated into other devices, such as portable phones or PDAs. Digital photographs 

15 may also be obtained from scanners that form image data files 1 14 from physical 

16 photographs (which may have been taken with either film cameras or digital cameras). 

17 The scanners may be connected to other suitable equipment, if necessary, such as 

18 personal computers. 

19 In this embodiment, the users 110 may include individual people or corporate 

20 entities. The users 110 may include commercial or non-commercial users. 

21 The users 1 10 operate devices 128 that are equipped to access a data network 134. 

22 The devices 128 include personal computers, PDAs, telephones, and so on. The devices 

23 128 may use any means now known or developed in the future for interfacing with the 

24 network 134. 

25 The network 134 may include any common data network, such as the Internet, or 

26 any other type of network capable of exchanging data, including public and private 

27 networks, POTS (plain old telephone service), wireless and land-based communications 

28 networks, and so on. 

29 The users 1 10 operate the devices 128 to access a photograph repository service 

30 140. The photograph repository service 140 is a combination of hardware and software 
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1 components. The photograph repository service 140 allows users to store and retrieve 

2 digital photographs. For these purposes, the photograph repository service 140 includes 

3 suitable hardware and software that enables users to conduct interactive sessions in which 

4 the digital photograph data files are exchanged between the users and the photograph 

5 repository service 140. For example, the photograph repository service 140 includes one 

6 or more servers or other computing platforms and appropriate programming. The 

7 photograph repository service 140 also includes one or more data storage devices, such as 

8 hard drives, tape drives, etc. 
9 

10 B. Operation - storage of digital photos 

1 1 The photograph repository service 140 includes applications 144 that provide 

12 functions to users. The applications 144 provide for interactive on-line sessions between 

13 users and the photo repository service 140. In one embodiment, the applications 144 

14 provide for accessing the photo repository service 140 using a web browser. 

15 Among the applications 144 is an acceptance application 150. The acceptance 

16 application 150 enables users 110 to store their digital photographs (as data) on a data 

17 storage medium 146 in the photo repository service 140. (The data storage medium 146 

18 may be one or more hard drives or other suitable equipment.) The acceptance application 

19 150 also enables users to categorize their stored photographs by location. To provide for 

20 this feature, the acceptance application 150 enables users to associate each stored 

21 photograph with one or more location references. A location reference is a data item that 

22 is associated with a photograph. The location reference may indicate a location from 

23 which the photograph was taken (i.e., the "vantage point"). Alternatively, the location 

24 reference may indicate the location of a feature in the photograph (i.e., an object 

25 location). In another alternative, a photograph may be stored with a composite location 

26 reference that indicates both the location from which the photograph was taken and the 

27 location of one or more features or objects in the photograph. 

28 Figure 2 shows a process 152 performed by the acceptance application 150. In a 

29 first step, a session is initiated between a user and the photo repository service 140 (Step 

30 154). Then, the photo repository service 140 receives a digital photograph (as a data file) 
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1 from the user 1 10 (Step 156). Next, the photo repository service 140 associates one or 

2 more location references with the photograph (Step 158). 

3 The location reference may be expressed in several different ways. For example, 

4 the location reference may be expressed as geographic coordinates (e.g., latitude, 

5 longitude, and optionally altitude). Alternatively, the location reference may be 

6 expressed as a street address (e.g., 1245 N. Main St., Springfield, Illinois, USA). 

7 According to another alternative, the location reference may be expressed as a point 

8 relative to a map. Alternative ways of expressing a location reference may be supported. 

9 The location reference to be associated with a digital photograph may be obtained 

10 in several different ways. Some cameras include positioning equipment, such as a GPS 

11 unit. These types of digital cameras are capable of determining a position (e.g., latitude 

12 and longitude coordinates) at which a photograph is taken. Data indicating the position 

13 are associated (e.g., linked, embedded) with the photograph image data file. 

14 Alternatively, the position information is overlaid on the photograph. 

15 Another way that the photo repository service 140 may obtain a location reference 

16 to associate with a photograph is from the user. The acceptance application 150 provides 

17 a means for the user to indicate a location to associate with a photograph. According to 

18 one alternative, the acceptance application 150 may provide entry fields in a web page 

19 displayed on the user's computing platform into which the user can indicate a location. 

20 The acceptance application 150 may provide various different ways for the user to 

21 indicate a location. For example, the acceptance application 150 may allow the user to 

22 specify geographic coordinates. Alternatively, the acceptance application 150 may allow 

23 the user to specify a street address or street intersection. Alternatively, the acceptance 

24 application 150 may allow the user to specify a point of interest or a well-known location. 

25 The acceptance application 150 may also allow a user to specify an inexact or fuzzy 

26 address (e.g., a zip code or a neighborhood). 

27 The acceptance application 150 also allows a user to provide additional 

28 information to be associated with a photograph (Step 160). This additional information 

29 may be optional. This additional information may include the identity (or alias) of the 

30 person submitting the photograph to the repository, an orientation (e.g., a compass 
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1 heading and elevation) of the camera when the photograph was taken, a date on which the 

2 photograph was taken, a time-of-day at which the photograph was taken, the date the 

3 photograph is being archived, a title to be associated with the photograph, a subject 

4 matter category to be associated with the photograph, restrictions imposed on sharing the 

5 photograph with other users, and a user-provided description or narrative to be associated 

6 with the photograph. Other information may also be included. For example, aperture 

7 setting, focal length and shutter speed may be included. 

8 Some of these types of information may be provided automatically, e.g., without 

9 requiring the user to input a value. For example, some cameras can automatically 

10 associate time-of-day data with a photograph. Similarly, cameras equipped with a 

11 compass or gyroscope can automatically associate orientation data with a digital 

12 photograph. Cameras can also automatically associate focal length, aperture setting and 

13 shutter speed data with photographs. 

14 As stated above, restrictions may be imposed on the sharing of photographs with 

15 other users. In one embodiment, the photo repository may support password protection 

16 of photographs. According to this feature, a user storing a photograph on the photo 

17 repository may specify a password to be associated with the photograph. The photo 

18 repository would then make the photograph available to only users who specify the 

19 password. 

20 Once the acceptance application 150 obtains the digital photograph, location 

21 reference information and any other information to be associated with the photograph 

22 from the user, the acceptance application 150 stores the digital photograph, location 

23 reference information and other associated information in a photo database 164 on the 

24 data storage medium 146 (Step 162). The acceptance application 150 stores the digital 

25 photograph, location reference information and other information so that the digital 

26 photograph is searchable. Accordingly, appropriate indexing or other data search 

27 techniques are used. In addition, appropriate indexing or other techniques may be used 

28 so that the digital photographs are searchable by any of the other stored information, such 

29 as by date, owner, and so on. 
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1 Figure 3 shows an embodiment of some of the data components associated with 

2 stored photograph images 1 14 in the photo database 164. 

3 Referring again to Figure 1, the acceptance application 150 may transform the 

4 location reference information into one or more alternative formats as part of the process. 

5 This transformation process is performed so that photographs may be searched by 

6 location using any of several alternative location referencing systems. As part of this 

7 process, the acceptance application 150 may geo-code the location information. As an 

8 example, if a user specifies a photograph location by street address, the acceptance 

9 application 150 may determine the geographic coordinates of the street address provided 

10 by the user and associate (e.g., store) the geographic coordinates as well as the street 

1 1 address specified by the user in the photo database 164. In order to perform this function, 

12 the acceptance application 150 may use a geographic database 170 that associates 

13 addresses and geographic coordinates. Such databases are available from commercial 

14 sources, such as Navigation Technologies Corporation of Chicago, Illinois. Similarly, if 

15 the user specifies geographic coordinates, the acceptance application 150 may determine 

16 a street address that corresponds to the coordinates and store the street address as well as 

17 the geographic coordinates in the photo database 164. Conversion to other location 

18 referencing formats may also be performed. 
19 

20 C. Operation - retrieval of photos 

21 Referring still to Figure 1, the photo repository service 140 also includes a 

22 retrieval application 174. The retrieval application 174 enables each user to retrieve 

23 his/her own photographs from the photo database 164. When retrieving photos, a user 

24 may use the location associated with the photo as a search criterion. Alternatively, a user 

25 may use any of the other attributes associated with a photo as a search criterion. The 

26 photo retrieval application 174 also provides a means by which users can obtain (e.g., 

27 retrieve) copies of photos taken by others from the photo database 164 using the location 

28 of the photo as a search criterion or alternatively, any of the other attributes associated 

29 with a photo as a search criterion. 
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1 The retrieval application 174 is accessed and used in the same or a similar way as 

2 the acceptance application 150. The user 1 10 operates the device 128 that is equipped to 

3 access the data network 134. The photo retrieval application 174 provides for an 

4 interactive on-line session between the user 1 10 and the photo repository 140. 

5 Figure 4 shows a process 178 performed by the photo retrieval application 174. 

6 In a first step, an interactive on-line session is initiated between a user and the photo 

7 repository service 140 (Step 180). Upon initiating the session with the photo repository 

8 140, the user is prompted to search for photos by location (Step 182). The user may be 

9 presented with labeled entry fields on a display of the device 128 used to access the photo 

10 repository 140. Alternatively, the user may be prompted to indicate the location using 

1 1 voice input. The user may specify the location in various ways. For example, the user 

12 may specify the location by geographic coordinates. Alternatively, the user may specify 

13 the location by street address. According to other alternatives, the user may specify the 

14 location by cross streets or by the name of the location. The user may also specify an 

15 approximate location (e.g., a zip code). 

16 In a present embodiment, the user may also provide one or more additional 

17 criteria to restrict the search for photos (Step 184). For example, the user may want only 

18 photos of 1245 Main Street, Springfield, Illinois that were taken between July 1, 2002 

19 and August 1, 2002. According to another alternative, the search may be restricted 

20 spatially. For example, the search may be restricted to a specified distance from a 

21 reference point (e.g., a search radius) or to a specified bounding area (e.g., a bounding 

22 rectangle). Appropriate input fields may be presented to the user for these purposes. 

23 Upon obtaining information from the user that specify the criteria for selecting 

24 photos, the photo retrieval application 174 conducts a search of the photo database 164 

25 for photos that match the specified criteria (Step 186). The matching photos, if any, are 

26 provided to the user (Step 1 88). Full copies of the matching photos may be provided to 

27 the user. Alternatively, only thumbnail copies of the matching photos may be provided 

28 initially with full copies available upon further selection by the user. According to 

29 another alternative, a count of the number of matches is provided to the user and the user 

30 is requested to indicate whether to transmit all, or just some of the photos. According to 
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1 still another alternative, if there are a large number of matches, the user may be provided 

2 with a portion of the results (e.g., ten matches), with a link to get another portion (e.g., 

3 the next 10) and so on. 
4 

5 m. ALTERNATIVES 

6 A. Peer-to-peer 

7 Figure 5 shows an alternative embodiment 200 of the photo repository system. In 

8 the embodiment of Figure 5, a peer-to-peer technology is used to store and exchange 

9 photographs. 

10 In Figure 5, each user 206 has a computing platform 210 that has a data storage 

1 1 device 214. The computer platform 210 may be a personal computer or PDA. The data 

12 storage device 214 may be a hard drive, CDROM or DVD. Other types of computing 

13 platforms and data storage devices may be suitable. The end users' computer platforms 

14 210 are connected to a data network 220, such as the Internet. 

15 Each end user has digital photographs stored on his/her data storage device 214 of 

16 his/her respective computer platform 210. The digital photographs are obtained from 

17 digital cameras 120 or from other sources, such as scanners. The digital photographs are 

18 stored as data files 230 in appropriate image formats, such as jpeg, gif, png, etc. 

19 In the embodiment of Figure 5, instead of transmitting copies of their digital 



20 photographs to a central photograph repository (as in the embodiment of Figure 1), each 

21 end user retains his/her copies of digital photographs on his/her own local data storage 

22 device 214 but makes the digital photographs available to other users over the data 

23 network 220. In order for users to find digital photographs of other users, each end user 

24 runs a peer-to-peer photo exchange program 240. 

25 The peer-to-peer photo exchange program 240 allows end users to conduct 

26 searches for digital photographs of other end users and to download selected digital 

27 photographs from the other end users' local data storage devices. In the embodiment of 

28 Figure 5, the peer-to-peer photo exchange program 240 provides for searching by 

29 location (i.e., the location where the photograph was taken or the location of an object in 

30 the photograph). 
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1 The peer-to-peer photo exchange program 240 is obtained from a map service 

2 provider 244 or other source. The peer-to-peer photo exchange program 240 installs a 

3 client component on an end user's computer. The peer-to-peer photo exchange program 

4 240 provides an indexing function that allows the photo files stored on an end user's 

5 computing platform to be categorized by location, e.g., with location references. The 

6 peer-to-peer photo exchange program 240 uses a geographic database 256 to geocode an 

7 end user's photographs. The geographic database 256 and geocoding software 258 may 

8 be located on a server associated with the photo service provider 244. As described in 

9 connection with the first embodiment, the peer-to-peer photo exchange program 240 may 

10 provide for various different ways of indicating location, such as by street address, 

11 geographic coordinates, and so on. Also as described in connection with the first 

12 embodiment, the peer-to-peer photo exchange program 240 may provide for different 

13 ways by which location data may be associated with a photograph. In addition, the peer- 

14 to-peer photo exchange program 240 may also provide for associating additional 

15 attributes (e.g., date, orientation, etc.) with photograph images and providing for searches 

16 based on these additional attributes. 

17 After an end user has associated a location with each digital photograph to be 

18 shared, the client component of the peer-to-peer photo exchange program 240 forms an 

19 individual index file 260. The individual index file 260 indicates the location references 

20 (and possibly other searchable attributes) associated with a user's photographs and 

21 includes references (e.g., pathnames) to the associated photograph data files. The 

22 individual index file 260 is transmitted over the data exchange network 220 to the map 

23 service provider 244. In this embodiment, the photograph data files are not transmitted to 

24 the map service provider 244 but instead remain on the user's local data storage device. 

25 The map service provider 244 receives an individual index file 260 from each 

26 user. The map service provider 244 integrates the individual index file 260 obtained 

27 from each user into a master index file 262. The master index file 262 indexes the 

28 photographic data files from all end users by their associated locations. When an 

29 individual index file 260 from a user is integrated into the master index file 262, 

30 references to the photograph data files on the end user's computing platform are 
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1 augmented with a reference to the end user's computer on the network, e.g., an IP 

2 address. 

3 Using the master index file 262, the peer-to-peer photo exchange program 240 

4 enables users to search for photographs stored on any data storage device (e.g., hard 

5 drive) connected to the network 220. The peer-to-peer photo exchange program 240 

6 enables searches for photographs by their associated location references (i.e., where the 

7 photographs were taken or the locations of features in the photographs). By providing a 

8 centralized master index, searches for photographs can be conducted quickly and 

9 efficiently. Keeping the photographs on the end users' local data storage devices reduces 

10 the need for providing a large amount of data storage on a server. 
11 

12 B. Standalone version 

13 Another alternative embodiment of a photo repository system 300 is shown in 

14 Figure 6. The embodiment of Figure 6 includes decentralized storage of photographs. 

15 According to this embodiment, each user has a computing platform 310 that runs a 

16 repository program 316 that provides for associating location data (and possibly other 

17 information) with digital photographs 318 and then search for digital photographs based 

18 on the associated location. In order to geocode the photographs, the repository program 

19 316 uses a geographic database 320 and a geocoding program 324. In one version of this 

20 embodiment, the geographic database 320 and geocoding program 324 are stored locally 

21 (i.e., on the end user's computing platform). In an alternative version of this 

22 embodiment, the geographic database 320 and geocoding program 324 are stored 

23 remotely (e.g., with a map service provider 326) and accessed over a network 328 by the 

24 local portion of the repository program 316. In still another version of this embodiment, 

25 the geocoding program 324 is stored locally and the geographic database 320 is stored 

26 remotely and accessed by the local geocoding program 324. The repository program 316 

27 provides that the digital photographs can be stored locally, i.e., on a data storage device, 

28 such as a hard drive 322, located with the end user's own computing platform 3 10. 

29 This embodiment is similar to the other embodiments in that the users are 

30 provided with a way to organize their digital photographs. The digital photographs 318 
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1 stored on a user's local hard 322 are associated with location references. As in the 

2 previously described embodiments, users may employ various search criteria to find 

3 photographs of interest. As in the previously described embodiments, users may search 

4 for photographs by location, i.e., the location associated the photograph. In this 

5 embodiment, the repository program 316 provides that the photographs stored locally are 

6 kept private and not necessarily shared with others. 

7 

8 C. Hybrid version 

9 Another alternative embodiment 400 of the photo repository system is shown in 

10 Figure 7. The embodiment of Figure 7 is a hybrid version that provides for both 

1 1 centralized and decentralized storage of photographs. In this embodiment, each user has 

12 a computing platform 410 that runs a repository program 416 (similar to the program 3 16 

13 in Figure 6) that provides for associating location data with digital photographs and then 

14 search for digital photographs based on the associated location data. Photographs are 

15 geocoded (i.e., associated with location references) using a local or remote geographic 

16 database 420 and local or remote geocoding software 424. The repository program 416 

17 provides that the user can store some digital photographs 418L locally on a data storage 

18 device 419 located with the end user's own computing platform 410 so that these 

19 photographs can be kept private and not necessarily shared with others. The repository 

20 program 416 also provides that the user can store some photographs 41 8R remotely in a 

21 photo database 428 on a data storage device 430 associated with a remotely located photo 

22 repository 440. The remotely stored photographs 418R are shared with other users, as 

23 described in connection with the first embodiment (in Figure 1). 

24 In this embodiment, the location referencing of locally stored photographs is 

25 compatible with the location referencing of remotely stored photographs. Searches may 

26 be performed for locally stored photographs, remotely stored photographs, or both locally 

27 and remotely stored photographs. Compatible location referencing facilitates the ability 

28 to interact with the remote photo repository 440 for sharing, purchasing, and selling 

29 photographs and other information (such as point of interest information). 
30 
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1 D. Groups 

2 According to this alternative, a photo repository system provides for the 

3 establishment of groups. A group refers to one or more users. A group can be 

4 established to include various users who have a common interest in sharing photographs. 

5 For example, a group may include all members of a family, all employees of a company, 

6 all employees of a company above (or below) a certain management level, all employees 

7 of a department in a company, all members of a labor union, all students or faculty of an 

8 educational institution, all residents of a neighborhood, all customers of a business, all 

9 members of a religious institution, clubs, societies, and so forth. In this embodiment, the 

10 photo repository allows stored photographs to be group-restricted. The photo repository 

1 1 allows photographs to be shared only within the group. 



12 In one alternative, all members of the group can store photos in, retrieve photo 

13 from or remove photos from the photo repository. In other alternatives, only some group 

14 members are authorized to store or delete photos. 

15 The photo repository may use various means to verify and authenticate group 

16 members. 

17 Groups may be implemented with various different embodiments of the photo 

18 repository system. For example, groups may be implemented with a centralized photo 

19 repository (e.g., Figure 1), a peer-to-peer photo repository (e.g., Figure 5), or a hybrid 

20 photo repository (e.g., Figure 7). 
21 

22 E. Other alternatives 

23 In one alternative embodiment, the photograph repository can provide a 



24 marketplace to buy and sell photographs. Photographs for sale may be photographs taken 

25 by professional photographers or that otherwise have value. According to this 

26 embodiment, a user accesses the photo repository and selects a location reference. The 

27 location reference may be a location from which the user took a photograph or may be a 

28 location in which the user has an interest. The photo repository identifies photos that 

29 match the user's search criteria and also indicates prices for the identified photos. The 

30 prices may be fixed or negotiable. If the user wishes the purchase an identified 
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1 photograph, the user pays for it using any available method for making on-line purchases. 

2 The buying and selling of photographs on the photo repository may be provided in 

3 addition to the free exchange of photographs. 

4 According to another alternative embodiment, the photo repository service may 

5 also provide navigation-related or map-related features. These navigation-related or 

6 map-related features may pertain to the locations of photographs. As an example, when a 

7 user obtains a photograph from the photo repository service, the user may be provided 

8 with routing directions (e.g., turn-by-turn driving instructions, pedestrian, inter-modal) to 

9 the location associated with the photograph. According to another alternative, when a 

10 user obtains a photograph from the photo repository service, the user may be provided 

11 with a map that shows the location associated with the photograph. 

12 In further alternative embodiments, a photo-taking location assistance feature is 

13 provided. According to this feature, an application (executed on a standalone, server, or 

14 hybrid system) allows a user to specify subject matter categories (e.g. historical sites, 

15 natural / scenic, etc.) that he/she wants to take pictures of. As the user travels through a 

16 geographic area, the user's position is determined on a regular basis by equipment (e.g., 

17 GPS, cell phone positioning) in the standalone, server, or hybrid system. The photo- 

18 taking location assistance feature of the application notifies the user when the user is in 

19 proximity to a location where a photo can be taken of an object of one of the user's 

20 specified subject matter categories. Alternatively, the application may direct the user 

21 (e.g., with driving or pedestrian routing instructions) to the location where a photo can be 

22 taken of an object of one of the user's specified subject matter categories. Once the user 

23 takes a picture, all the other repository-related functions mentioned in connection with 

24 the various embodiments apply. 

25 In another alternative embodiment, the photo repository may include links to web 

26 cam feeds. These web cam feed links would be categorized and searchable by location. 

27 According to this embodiment, the photo repository service includes an acceptance 

28 application for web cam links. This acceptance application for web cam links would be 

29 similar to the photo acceptance application described above. A user who is operating a 

30 web cam would provide a link to the web cam's network address. The user would also 
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1 indicate the physical location (e.g., geographic coordinates, street address, etc.) of the 

2 web cam, and possibly other information, such as the orientation of the web cam, 

3 permissions, etc. The link and location information would be stored in a database file at 

4 the photo repository. (The web cam links may be stored in the same database used to 

5 store digital photographs, or alternatively the web cam links may be stored in a separate 

6 database.) Using this information, the photo repository service would be a resource for 

7 viewing live conditions anywhere in the world. As an example, a user may want to get a 

8 live view of weather conditions at a particular location. The user would search the photo 

9 repository database for a web cam feed associated with that particular location. If a web 

10 cam feed is available for the desired location, the link to that web cam is sent the user. 

1 1 Then, the user uses the link to receive the web cam feed to observe conditions at the 

12 location. 

13 Another use for the photo repository is to provide evidence in judicial matters or 

14 to aid investigations. As an example, the photo repository could be used to find 

15 photographs of a particular location taken on a particular day in order to corroborate a 

16 witness's testimony. The photo repository might also be used to establish before-and- 

17 after conditions at sites of accidents, fires, etc. 

18 Another way that the photo repository can be used is to view sites that were 

19 visited in the past to observe how they have changed. For example, a user may store a 

20 series of photos showing locations visited on a vacation. Years later, the user may obtain 

21 current photographs of those same locations in order to see how they have changed. 

22 According to another embodiment, the photos stored in the photo repository by 

23 users can be used by a map developer to create new maps or update existing maps. 

24 Because photos stored in the repository are indexed by location, a map developer can use 

25 the photos taken by users to obtain information about the locations in the photos. As an 

26 example, if a photo taken by a user shows a bridge, the map developer can examine the 

27 photo to obtain information about the bridge, such as the number of lanes of traffic, the 

28 bridge height, the bridge length, road signs, and so on. Similarly, a user's photo of a 

29 building can be used by the map developer to obtain information about the building 

30 height, footprint, address, and so on. The information obtained in this manner may be 
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1 



used directly by a map developer for creating or updating a map, or alternatively, the 

2 information obtained in this manner may be used by the map developer to determine 

3 where to send field personnel for updating purposes. 

4 The various embodiments of the photo repository may include versions 

5 particularly designed for either home or business uses. 

6 In some of the embodiments disclosed above, photo repository software or data 

7 are stored locally on an end user's computer platform. In these embodiments, the 

8 software or data may be downloaded to the end user's computer platform. Alternatively, 

9 the software or data may be provided on media (e.g., CD-ROM) delivered to the end 

10 user. 

1 1 In another embodiment, the photo repository can provide users a feature that 

12 allows a plurality of stored photographs to be associated with each other. As an example, 

13 a user may take a number (e.g., 50) of photographs while on a vacation. According to 

14 this embodiment, the photo repository allows the user to associate these photographs as a 

15 set. The user may be allowed to name the set (e.g., Hawaiian vacation, August 2003). 

16 When the user wishes to retrieve these photos for viewing, the photo repository would 

17 allow the user to retrieve the photos as a set. 

18 It was stated above in connection with the embodiment of the photo repository 

19 that used peer-to-peer data exchange technology that photos stored on end users' 

20 computers were referenced by a link that included the end user's network address. One 

21 way to implement this is to establish a separate domain or suffix to be used for photo 

22 links, e.g., .pix. 

23 There are various ways to generate revenue from the operation of embodiments of 

24 the photo repository. In one alternative, end users pay a fee for storage of photographs in 

25 the repository. Alternatively, end users pay a fee for downloading photographs of others. 

26 In another alternative, advertising is presented to the users when they access or use the 

27 photo repository. Alternatively, advertising may be added to or overlaid on downloaded 

28 photographs. In alternatives in which users install repository software or geographic data 

29 locally, the users may pay a fee (e.g., a license fee) for the software and/or data. 
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1 As mentioned above, a user may search the photo repository for stored 

2 photographs based on search criteria other than location. In one embodiment, users may 

3 search the photo repository for photographs by color or color combination. In this 

4 embodiment, a user may want a photograph having a specific color or combination of 

5 colors for decorating purposes, for example. According to this embodiment, the photo 

6 repository supports searches of stored photographs based on the dominant color or color 

7 combinations in the photographs. Searches may combine color with other criteria (e.g., 

8 photographs of the Grand Canyon that have strong red colors). 

9 According to another embodiment, the photo repository includes a free text search 

10 engine. This would enable searches for photos based on any word or phrase associated in 

11 any way with a photograph. Inexact and fuzzy matches would also be supported. 

12 Another feature included in an alternative embodiment of the photo repository 

13 provides for automatic recognition of placenames when entering text. As mentioned 

14 above, some embodiments of the photo repository allow a user to provide a description, 

15 title or narrative to be associated with a photograph when the photograph is being stored. 

16 The user may provide these types of information as text. According to this feature, if a 

17 user indicates a placename when providing text for a description, title or narrative, the 

18 photo repository automatically identifies the potential placename and asks the user to 

19 confirm that the identified text is the placename of the location associated with the 

20 photograph. As an example, if a user provides the text 'This is a picture of the Empire 

21 State Building at noon" for a description to be associated with a digital photograph being 

22 stored, the photo repository automatically identifies the text "Empire State Building" as 

23 the name of a place and asks the user to confirm that the object in the picture is the 

24 "Empire State Building." If the user confirms that the object in the picture is the Empire 

25 State Building, the photo repository automatically associates the location of the Empire 

26 State Building with the photo being stored. The photo repository can automatically 

27 identify placenames in text by comparing user-entered text to a table of placenames, 

28 searching user-entered text for placename patterns (e.g., "1245 Main Street", first letter 

29 capitalized words), or various other means. 
30 
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1 It is intended that the foregoing detailed description be regarded as illustrative 

2 rather than limiting and that it is understood that the following claims including all 

3 equivalents are intended to define the scope of the invention. 

4 
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